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(57) A video reproduction apparatus according to 
the present invention reproduces externally supplied 
package media. The package media contains video 
content storing video date and playback control data 
controlling reproduction of the video data in a specified 
data format, and extensible application software using 
the video content. The video reproduction apparatus in- 
cludes as software pre-stored and executed in internal 
memory an operating system chosen from operating 
systems of plural types, middleware for absorbing dif- 
ferences in function according to the type of operating 
system, and a player application that runs on the mid- 
dleware level for reproducing the video content. The 
middleware has a class library including tools used by 
the player application to play back the package media 
or to run the extensible application software. The player 
application consistently reproduces the video content of 
the package media according to the specified format by 
way of the tools included in the middleware class librar- 
ies. The extensible application software is run through 
the tools included in the class libraries of the middleware 
using video content contained in the same package me- 
dia. 
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Description 

BACKGROUND OF THE INVENTION 
5 1 . Field of the I nventicn 

[0001] The present invention relates to package media recording movies and other such digital video content, and 
to a video reproduction apparatus, video reproduction method, and video reproduction program using the same. More 
particularly, the present invention relates to an e-package, a technology Tor replacing DVD. 

10 

2. Description of Related Art 
(Package business) 

15 [0002] Change in the package business is described first. 

[0003] Fig. 1 shows the package business distribution format of today and the future. As shown in Fig. 1, package 

business distribution concerns how movies and other content owned by a content provider are distributed to users. 

[0004] In recent years movies and other such content have been supplied from content provider to user using DVDs. 

[0005] The DVD format has greatly improved the efficiency of the distribution business compared with distribution 
20 using conventional video cassettes because the manufacturing cost is reduced by using a stamping, process, trans- 

portation costs are reduced because of smaller space requirements, and less shelf space is required for display at the 

retail level. 

[0006] DVD also offers significant advantages and added value compared with video cassettes, including high picture 
quality, high sound quality, random accessibility, and such interactive functions as multi-angle viewing. 
25 [0007] Content value is described next. 

[0008] Fig. 2 shows the concept of content value. Conventional video tape records a linear title on tape. In other 
words, video tape is a medium for providing a movie identical to what is projected in the movie theater, and has no 
additional value. 

[0009] On the other hand, DVD has additional value, such as interactive functions as multi-angle and multi-story 
30 viewing, title selection from menu, random accessibility, and multi-lingual as sound and caption, except for value of 
the movie content itself. 

[0010] Content loses value for various reasons. For music, for example, these include popularity. Much musical 
content loses value drastically overtime as fashions change. The same trend is found with movies. 
[0011] On the other hand, movies include a story. Viewers interested in the development of a story will watch the 
35 sequel. Viewers that already know. the story, however, are less motivated to watch the sequel. In other words : the 
content loses value for individual viewers. 

[0012] This is why there are few people that watch the same movie everyday but there are many people that listen 
to the same music everyday. Statistically, value drops gradually in the market for particular content as the population 
of people that have seen the movie increases. 
40 [0013] Fig. 3 shows value of content over the time axis and the corresponding movie business. Time is shown on 
the horizontal axis, and content value is shown on the vertical axis. 

[0014] Movies have a unique "time shift" business model. Movies are first shown in movie theaters and are later sold 
to individual end users as packaged software such as DVDs. Movies are then supplied to pay-channels such as pay- 
per-view services using satellite and cable broadcasting media, and last are made available for free distribution by 
45 terrestrial broadcasters. While individual users can view content for free with terrestrial broadcasts, these broadcasts 
are supported by advertising revenue from corporate advertisers. 

(The DVD example) 

50 [001 5] Technology supporting the conventional package business is described below using DVD by way of example. 
It should be noted that unless otherwise specified DVD as used herein refers to DVD-ROM, that is, a read-only disc, 
and does not refer to DVD-RAM and other such recordable discs. 
[0016] Fig. 4 shows the structure of data recorded to a DVD. 

[0017] The recording area of a DVD disc has a capaciLy or approximately 4.7 GB (gigabytes) starting with a lead-in 
55 area for stabilizing the servo of the DVD drive, followed by a logical address space for recording two values. 0 or 1 , 
and ending with by a lead-out area indicating the end of the disc recording area. 

[0018] The logical address space starts with a file system recording area followed by navigation data describing the 
AV data and movie scenario. 
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[001 9] The file system is a system for managing data as files and directories (folders), and all AV data and navigation 
data recorded to the DVD disc can be handled as directories and files through the file system. 

[0020] As shown in Fig. 4, a directory, called the VIDEO_TS directory, storing the DVD video titles is recorded directly 
below the root directory on a DVD disc. This directory contains files such as the VIDEOJTSJFO and VTS_0t_0.IFO 
5 files recording navigation data enabling scenario management and interactivity, and a VTS_01_0.VOB file recording 
AV data. 

[0021] A stream conforming to the ISO/IEC 1 381 8 (MPEG) standard is recorded as the AV data. One MPEG stream 
is called a VOB in the DVD format, and plural VOB objects are recorded to files having the ".VOB" extension. Plural 
VOBs are recorded sequentially to one VOB file, and if the size of a VOB file exceeds 1 GB, the VOB file is segmented 

10 and recorded as plural VOB files each no more than 1 GB. 

[0022] The navigation data broadly includes VMGI data for managing the entire disc, and VTSI data relating to the 
individual files. Included in the VTSI data is PGC information containing Ceils defining all or part of a VOB (MPEG 
stream) as the reproduction unit. A Cell defines the reproduction sequence. What is important to note here is that while 
a Cell is used to indicate part or all of a VOB, a Cell is address data referencing the logical address space. 

15 [0023] With the hard disk drive (HDD) of a computer, for example, there is no guarantee that any same file will always 
be recorded to the same place on the hard disk because files are repeatedly recorded, edited, and deleted. The biggest 
feature of the file system is that applications treat the file as the same file regardless of where the file is recorded on 
the hard disk. 

[0024] DVD enables a fusion of AV and PC technologies, and while it provides a file system DVD also uses a data 
20 structure that is logical address aware. The performance of consumer AV equipment is far from PCs. In fact, there 
. were even concerns about including a file system as part of DVD performance when DVD was first introduced. There 
were, however, high expectations for using DVD with both consumer electronics and personal computers. Today, in 
fact personal computers equipped with the ability to read DVDs are not rare. 

[0025] In other words, DVD was preferably to provide both practical performance in consumer electronics and the 
25 ability to be accessed with personal computers. The DVD standard was therefore designed so that PCs can access 
data through the file system while consumer AV products without a file system function can access the data through 
the logical address space. 

[0026] DVD was therefore able to gain broad support from users of both consumer electronics and personal com- 
puters. 



30 



(Problems with the DVD standard) 



[0027] The distribution model of the present and future package business is described with reference to Fig. 1 . As 
shown in Fig. 1 explosive growth in the Internet and deployment of practical satellite broadcasting services mean that 

35 package distribution is no longer limited to methods using physical discs. . 

[0028] Some types of content are already distributed as data streams over the Internet. Set-top boxes (STB) with a 
built-in hard disk drive (HDD) as a temporary storage medium have also become available in the last few years. Digital 
broadcasts are recorded to the hard disk drive for viewing at a later time. It will thus be apparent that the content 
business environment is changing dramatically. 

40 [0029] Distribution of movie content is also expected to change from distribution via DVD and other physical media 
to electronic distribution using the Internet and digital broadcasting. 
[0030] Fig. 5 shows a residential configuration of AV equipment. 

[0031] The environment surrounding AV equipment has been changed greatly by the Internet and digital broadcast- 
ing. A home network is needed to, for example, connect AV equipment to the Internet, connect a set-top box (STB) for 

45 receiving digital broadcasts to a recorder and television, and interconnect the various components. 

[0032] Content distribution via digital broadcasts in particular is push mode distribution whereby a one-way data 
stream is simply sent from the distributor rather than pull mode distribution whereby content is sent in response to user 
requests sent via the Internet, for example. This situation requires a system to protect the copyright of the distributed 
content. Copyright protection systems are being achieved using a combination of encryption technology and the Digital 

50 Rights Management (DRM) system technology. 

[0033] Also required is technology for managing content value. For example, greater added value than is provided 
by current DVDs as shown in Fig. 2, and a system for managing content value according to the distribution cycle and 
distribution channel as indicated by the time shift model shown in Fig. 3, are needed. The structure of existing DVDs 
does not enable adding new added value or management features because it is based on selling the discs (sell- 

55 through). 
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(Problems with content distribution) 



[0034] A problem with content distribution is the number of competing digital broadcasting systems. 

[0035] In Japan, for example, both communication satellite (CS) digital broadcasts and broadcast satellite (BS) digital 
5. broadcasts are available, and CS 110°, a new combination of broadcast satellite and terrestrial digital broadcasting, 

is about to start operation. Different digital broadcasting systems are used in different European countries, but there 

is a trend towards standardizing on the DVB (Digital Video Broadcasting) system. This DVB system, however, differs 

from the Japanese system. A proprietary system known as ATS is being considered in North America. 

[0036] Managing the different systems used for digital broadcasting in different regions is even more complicated 
10 than the NTSC and PAL systems : for example, used with conventional analog broadcasts. 

[0037] Content such as movies thai are marketed throughout the world must therefore be authored for particular 

regions, and this can be expected to greatly increase production cost. 

[0038] One potential solution to this problem is a standardized worldwide electronic distribution package for elec- 
tronically distributing content comparable to DVDs. However, if this electronic distribution package simply replaces 
15 pay-channel broadcasts and free terrestrial broadcasts : the same content available on DVD can be enjoyed via free 
terrestrial broadcasts, thus reducing user desire to purchase DVDs and presenting the danger of destroying the DVD 
business. 

[0039] There is therefore a need for technology adding new added value according to the content distribution cycle, 
such as technology for managing added value by imposing limits on the ability to playback content according to the user. 

20 

SUMMARY OF THE INVENTION 



[0040] An object of the present invention is therefore to resolve the above-described problems of adding added value 
to content, and managing content value according to the distribution cycle and distribution channel. More specifically, 
25 an object of the invention is to provide e-package technology for building a new content business appropriate to the 
network age. 

(Method of solving the problem) 

30 [0041] In accordance with one aspect of the present invention, there is provided a video reproduction apparatus for 
reproducing externally supplied package media. The package media containing video content storing video data and 
playback control data controlling reproduction of the video data in a specified data format, and extensible application 
software for using the video content. The video reproduction apparatus includes as software stored and executed in 
internal memory, an operating system, middleware, and player application software. The operating system is chosen 

35 from operating systems of plural types. The middleware absorbs differences in function according to the type of oper- 
ating system. The player application software runs on the middleware level for reproducing the video content. The 
middleware has a class library including tools used by the player application to play back the package media or to run 
the extensible application software. The player application software consistently reproduces the video content of the 
package media according to the specified format by way of the tools included in the middleware class libraries. The 

40 extensible application software runs by way of the tools included in the class libraries of the middleware using video 
content contained in the same package media. 

[0042] This video reproduction apparatus reproduces e-package video content. The operating system could be, tor 
example, the Microsoft Windows (R) operating system, the Mac OS (R) from Apple Computer, or the freeware Linux 
operating system. The operating system shall also not be limited to these systems and includes operating systems 

45 from other manufacturers. The middleware could be Java, for example. Functional differences resulting from differences 
in the type of operating system can be absorbed by the middleware. The player application software reproduces the 
video content of the package media. The extensible application software could be, for example, a game application 
using the video content of the package media. The player application software and extensible application software 
operate at the middleware level. The middleware also has class libraries containing tools used by the application 

so software when it runs or reproduces the video content. The tools contained in the middleware refer to the classes and 
member functions thereof for achieving various functions, for example. It will also be noted that this video reproduction 
system can be achieved by running software distributed over a network. 

[0043] Preferably, the video reproduction apparatus manages playback status data, the playback control data of the 
package media includes playback restriction data corresponding to the playback slaLus data, and the extensible ap- 
55 plication software sets a tool contained in the class libraries of the middleware to an invalid state by analyzing the 
playback control data and comparing the playback restriction data in the playback control data with the playback status 
data. 

[0044] In another aspect of the present invention , there is provided a video reproduction method for reproducing 
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externally supplied package media with a video reproduction apparatus. The package media includes video content 
storing video data and playback control data controlling reproduction of the video data in a specified data format, and 
extensible application software for using the video content. The video reproduction method includes the steps of: 

5 a step for reading into internal memory of the video reproduction apparatus and activating an operating system 

chosen from operating systems of plural types; 

a step for reading into internal memory of the video reproduction apparatus and activating middleware for absorbing 
differences in function according to the type of operating system, the middleware having a class library including 
tools used by application software operating at the middleware level to run or reproduce the package media; 
10 a step for reading into internal memory of the video reproduction apparatus and activating a player application 

operating at the middleware level for reproducing the video content; and 

a step for reading into internal memory of the video reproduction apparatus and activating extensible application 
software operating at the middleware level and using the video content. 

15 [0045] Additionally, the player application software consistently reproduces the video content of the package media 
according to the specified format through the tools included in the class libraries of the middleware. The extensible 
application software also runs by way of the tools included in the class libraries of the middleware using video content. 
[0046] In a further aspect of the present invention, there is provided a video reproduction program for reproducing 
externally supplied package media. The package media contains video content storing video data and playback control 

20 data controlling reproduction of the video data in a specified data format, and extensible application software for using 
the video content. The video reproduction program includes as software stored and executed in internal memory, an 
operating system, middleware, and player application software. The operating system is chosen from operating systems 
of plural types. The middleware absorbs differences in function according to the type of operating system. The player 
application software runs on the middleware level for reproducing the video content. The middleware has a class library 

25 including tools used by the player application to play back the package media or to run the extensible application 
software. The player application software consistently reproduces the video content of the package media according 
to the specified format by way of the tools included in the middleware class libraries. The extensible application software 
runs by way of the tools included in the class libraries of the middleware using video content contained in the same 
package media. 

30 [0047] In addition, a computer-readable recording medium according to the present invention stores the above video 
reproduction program. 

[0048] In a still further aspect of the present invention, there is provided a package media externally that is supplied 
to a video reproduction apparatus and reproduced by the video reproduction apparatus. The package media contains 
video content storing video data and playback control data controlling reproduction of the video data in a specified data 

35 format, and extensible application software for using the video content. The video reproduction apparatus includes as 
software stored and executed in internal memory, an operating system : middleware, and player application software. 
The operating system is chosen from operating systems of plural types. The middleware for absorbs differences in 
function according to the type of operating system. The player application software runs on the middleware level for 
reproducing the video content. The middleware has a class library including tools used by the player application to 

40 play back the package media or to run the extensible application software. The player application software consistently 
reproduces the video content of the package media according to the specified format by way of the tools included in 
the middleware class libraries. The extensible application software runs byway of the tools included in the class libraries 
of the middleware using video content contained in the same package media. 

[0049] This package media is an e-package with high added value. That is : the video content of this package media 
45 js not limited to being reproduced by the player application software, and can also be run in conjunction with game 
application software that uses ihe video content, for example. In addition, the package media may contain scenario 
data defining the playback sequence of the video data in the playback control data. Yet further, the playback control 
data can contain playback level data setting a level controlling the use of a game application or the playback of video 
content. 

50 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0050] The present invention will become readily understood from the following description of preferred embodiment 
thereof with reference to the accompanying drawings ; in which like parts are designated by like reference numeral and 
55 in which: 

Fig. 1 is a conceptual drawing of the package business; 
Fig. 2 is a conceptual drawing showing content value; 
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Fig. 3 is a conceptual drawing showing the time shift business in movies; 

Fig. 4 illustrates the structure of the DVD standard; 

Fig. 5 shows a typical configuration of AV equipment in the home; 

Fig. 6 shows the concept of links between video titles; 
5 Fig. 7 shows the concept of new value; 

Fig. 8 is a conceptual drawing of e-package levels; 

Fig. 9 shows the concept of Various standards; 

Fig. 1 0 shows the configuration of a middleware model player; 

Fig. 1 1 shows the concept of a "player application; 
10 Fig. 12 shows the concept of a "game" application; 

Fig. 13 shows the concept of a "movie link" application; 

Fig. 14 shows the structure of an e-package specification; 

Fig. 1 5 shows the directory and file structure; 

Fig. 16 shows a listing of the package data; 
75 Fig. 1 7 shows a listing of the menu data; 

Fig. 1 8 shows a listing of the title data; 

Fig. 1 9 shows a listing of the stream data; 

Fig. 20 shows a listing of the subtitle stream; 

Fig. 21 shows the stream structure; 
20 Fig. 22 is a block diagram of the video reproduction apparatus: 

Fig. 23 shows the software structure; 

Fig. 24 is a class listing; 

Fig. 25 is a flow chart of the Package class process; 

Fig. 26 is a flow chart of the Title class process; 
25 Fig. 27 is a flow chart of the Menu class process; 

Fig. 28 is a flow chart of the Audio class process; 

Fig. 29 is a flow chart of the Event class and Link class process; 

Fig. 30 is a flow chart of the playback process of the player; 

Fig. 31 shows a sample menu; 
30 Fig. 32 is an example of operation while playing back a title; 

Fig. 33 is a flow chart of the enableEvent function; 

Fig. 34 is a flow chart of the Cursor class process: 

Fig. 35 is a flow chart of the Status class process; 

Fig. 36 is a flow chart of the Canvas class process; 
35 Fig. 37 is a flow chart of the game application playback process; 

Fig. 38 shows the concept of an update Status operation; and 

Fig. 39 is a flow chart of the Package class. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

40 

[0051] A preferred embodiment of the present invention is described below with reference to the accompanying 
figures. It should be noted that like reference numerals represent like parts in the figures. 

(A new business model) 

45 

[0052] As described with reference to Fig. 2 and Fig. 3, the value of movie content decreases with time. In addition, 
the existing business model must be changed in order to advance electronic distribution worldwide. 
[0053] Package media according to this embodiment of the invention (referred to below as an "e-package") containing 
digital movie content introduces an application suited to movies as added value as shown in Fig. 2. This increases the 
50 value of the package. The value derived from the application can also be controlled and different package levels can 
be used for differentiation of even a single title. 

[0054] Package value could be controlled as shown in Fig. 8, for example, by providing a 'lull package" enabling all 
applications, a "limited package" enabling using of only some applications, and a "free package" enabling only viewing 
the movie conlenl. 

55 [0055] In the package business shown in Fig. 3, the full package could be distributed in place of existing DVDs, the 
limited package in place of pay channel broadcasts, and the free package in place of free broadcasts. 
[0056] This embodiment of the invention is described using only three levels, but it is also possible to further refine 
the package levels and develop a more targeted distribution business. 
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(Structure of various standards) 

[0057] The standards and concepts of such typical media as CD, DVD S DVB-MHP, and e-package are described 
below using Fig. 9. It should be noted that VHS is a set of physical characteristics and electrical signals : and differs 
5 greatly from other standards having a data structure, and further description of VHS is therefore omitted. 

[0058] CDs have data sampled at 44.1 kHz sampling frequency and a TOC (Table Of Contents) containing index 
data for individual tracks (songs). A CD player reads the TOC, receives a request from a user (such as to play track 
3), reads the data for the corresponding song, and applies D/A conversion to play the song. 

[0059] Although not shown in the figure, Video CD, an enhanced CD version, records an AV stream and correspond- 
10 ing index called a PSD (Programmable Sequence Descriptor). A Video CD player reads and decodes a requested AV 
stream according to user operations. 

[0060] The data structure is standardized and the player interprets and reproduces the data structure according to 
the standard with both CDs and Video CDs. 

[0061] The concept of a virtual machine was introduced with DVD. This is a configuration having an operation 
15 processing function and register (dedicated memory) just like a CPU. DVD player operation differs according to user 
input and register values based on the scenario data recorded as the data structure. 

[0062] To describe a simple example, a story could branch depending upon whether the viewer is an "adult" or a 
"child under 1 8 years of age." This is what the "parental lock" function does. Sexually explicit scenes and violent scenes 
in the movie are removed so they are not shown to children. It is also possible to change the story and angle according 

20 to whether the viewer is male or female. 

[0063] In addition to a static data structure, the DVD standard also defines an operating model for the player (also 
called a video reproduction apparatus) as a virtual machine. This assures compatibility between different players by 
absorbing differences the in hardware and software platforms of different disc player manufacturers and software im- 
plementations of the player application. 

25 [0064] The DVB-MHP (Digital Video Broadcasting Multimedia Home Platform) is described next. DVB-MHP is a next- 
generation digital broadcasting specification that is being standardized in Europe. The biggest feature of this specifi- 
cation is that it uses Java middleware. 

[0065] Java is middleware promoted by Sun Microsystems as a way to improve compatibility between platforms. All 
Java applications will run on a computer or device equipped with Java, and the greatest feature of Java applications 
30 js that they are not limited to a particular platform and can be used in a wide range of operating environments. 

[0066] In Japan steps are being taken to implement Java on NTT DoCoMo's i-mode service and in HAVi, a home 
AV equipment networking system. 

[0067] With the introduction of Java, DVB-MHP also defines an object class and interface specifically for DVB-MHP, 
that is, for processing video programs from television broadcasters and data broadcasting programs. 
35 [0068] DVB-MHP differs from conventional standards in that it does not define a static data structure, but instead 
defines a middleware interface as the standard. 

[0069] This means that anything that can be created as a computer program can be used in the application. On the 
other hand, no system for creating the application is provided. When compared with the conventional content business, 
the applications are therefore closer to- a computer game than to music : movies, or other AV source. 

40 [0070] An e-package according to the present invention provides middleware similarly to DVB-MHP so that various 
applications can run on the player. However, it is preferable to have a conventional type of static data structure and a 
player operation model such as a virtual machine in orderto efficiently create the largest type of content, that is, movies. 
[0071] For this reason an e-package according to the present invention defines a static data model suitable for movie 
content and a player operation model. This e-package also provides an interface for an application that increases the 

45 value of movie content. 



(Player model) 

[0072] Fig. 1 0 shows the concept of a player model implemented using middleware. 

so [0073] An object oriented programming language such as Java is used forthe middleware in this example. Numerous 
books and papers about object oriented programming languages and their basic classes are publicly available from 
various Internet web sites, and further details, particularly about class library processing, are therefore omitted here. 
[0074] Functions such as the title and language setting are defined by classes and member functions of the e-package 
middleware. An instance of each class is instantiated when the class is run, and can then be accessed by the player 

55 application or other application. 

[0075] Classes are briefly defined below. The ovals in Fig. 10 indicate an instance of each class. 

[0076] TheTltle class is a unique e-package class equivalent to a movie title. Each class contains scenario information 

such as chapters, AV data address information, and interface data supplied to the application. 
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[0077] All of this information is written to a playback control data file (shown in the bottom row of the figure). Attributes 
described by the playback control data are used as the object attributes. For example, the level attribute of the Title 
instance is specified by the level attribute of playback control data Title. 
[0078] A Title class also has member functions (methods) for playback control. 
5 . [0079] For example, a title is played by calling the Play() function, and playback is stopped by calling the Stop() 
function. 

[0080] The function of these member functions (methods) is also controlled by the playback control data. Use of the 
Title instance SetRate function (a special playback function, for example, is limited by setting the <SETRATE level ='"'> 
attribute In the playback control data. 
10 [0081] The Audio class is equivalent to the audio stream. This class is instantiated for each audio stream. Each 
instance contains stream attributes and language information. The audio stream language information, for example, 
is defined by setting <AUDIO language = "Japanese"> in the playback control data. This attribute can be fetched from 
the Audio instance using the member function getl_ang(). 

[0082] The e-package is compatible with multiple languages, similarly to DVD, and the user can select the audio 
15 stream of choice. The player application receives a user request and instantiates (sets) a corresponding Title class 
instance. The language setting is then detected using the getLang() member function of each Audio instance as de- 
scribed above to select the Audio instance matching the user request, and passed (set) to the Title instance. 
[0083] The Subtitle class is equivalent to the subtitle stream, and has substantially the same functions as the Audio 
class. 

20 [0084] The Socket class is for communicating over a network with other players (video reproduction apparatuses) 
and servers, for example. 

[0085] The Loader class is for dynamically loading other applications. Applications dynamically loaded by the Loader 
class are defined in the playback control data file. The Loader class is normally used to reproduce other applications 
using the player application. However, it is not always necessary to call the Loader class when an application containing 
25 a player function is run. 

[0086] The Event class is for generating an event trigger described in a scenario. It could be used to display dialog 
for the user during the movie, for example. 

[0087] The Cursor dass is for passing cursor movements by the user to the application. It catches movement of the 
cursor, for example, using a remote control. 
30 [0088] The Button class, Canvas class, and Frame class are for displaying a button, canvas, and frame, respectively, 
on the screen. These classes are drawn by generating an instance and adding it to the screen. 
[0089] The Canvas class in particular is for drawing moving pictures. A moving picture is presented on screen by 
adding a Title instance to an instance of the Canvas class. Displaying a moving pbture is terminated by removing 
(deleting) the Title instance. 

35 [0090] The Text class is used for displaying text on screen. Text is drawn on screen by the constructor creating a 
Text instance and adding the Text instance to the Canvas instance. 

(Sample application) 

40 [0091] The application described below can be achieved by means of the player model described above. 

[0092] An example of a simple DVD player is shown in Fig. 11 . As shown in Fig. 11 the DVD player application is 
also loaded as a middleware application. The player application creates an instance using the class libraries provided 
by the middleware and calls the member functions of the instance to playback a title. 

[0093] For example, menus are displayed on screen by adding a menu instance created from the Title class to a 
45 Canvas instance to accept user requests. The user then uses the cursor to select a title to be played. 

[0094] User requests pass through an instance of the Cursor class to reach a title or menu. For example, an instance 
of the Title class corresponding to the title selected by the user is created with a menu, added to a Canvas instance, 
and played. 

[0095] Fig. 12 shows an example of a game application. 
so [0096] A game application is run instead of the player application in Fig. 1 2. The game application selects a desired 
screen from the titles included in the package and displays it as the background screen for the game. The game 
application adds a 3D polygon to the background image and advances the game. The basic operation is the same as 
the player application described above except that the application program is a game application instead of a special 
player application. 

55 [0097] It is, of course, possible to minutely control the background image and display it synchronized to the game. 
[0098] Fig. 13 shows an example of links between titles. 

[0099] As describee above, much movie content is recorded on the home server. Which movie titles are actually 
recorded is different in each family, and the links between the titles cannot be singularly defined as shown in Fig. 13. 
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[0100] The structure of an e-package according to the present invention therefore contains information defining which 
titles are linked to each title, and considers only those links to actually valid titles to be valid for playback. 
[0101] For example, Titlel in this example has links to Title2, Title3, Title5, and Title6, but Titles is not on the home 
server. Valid links during the playback of Titlel are therefore Title2 ; Title3, or Titles. It is thus possible to dynamically 
5 select only those links that can be reproduced. 

(Structure of the standard) 

[0102] Fig. 1 4 shows the structure of the standard. 
10 [0103] As shown in Fig. 14, the e-package standard consists of three major parts, the player model, data structure : 
and AV data. 

[0104] The player model is designed as a class library of an object oriented programming language, and creates 
instances of the menus, titles, and other functions based on the playback control data for the application. 
[0105] As shown in Fig. 14, the data structure includes package data for managing the overall package, menu data 
15 describing the menus . title data describing scenarios for each title, and stream data describing attributes for and address 
information for accessing each stream. These are described in detail below. 
[0106] The package directory and file structure is described first with reference to Fig. 15. 

[0107] An e-package may be distributed as a single optical disc in the same way DVDs are distributed, or electron- 
ically over a network for storage to a hard disk drive. The directory (also referred to as a folder) and file structure 
20 described here is common to both distribution formats. 

[0108] An e-package introduces a file system similarly to DVDs. 

[0109] A PACKAGE directory is located directly below the root directory in the e-package file system. This directory 
is a specialized e-package directory and is not used by other applications, including conventional DVD data. Subdi- 
rectories are located below the PACKAGE directory, each subdirectory rotating to a single package. The subdirectories 
25 in Fig. 15 are labelled "abc" and "def." 

[0110] Stream data and various management data files are stored under each subdirectory. The first file, package, 
xml, is a reserved file used for recording the above-described package data. Other files include menu.xml describing 
the menus, titlel .xml and title2.xml describing the title, and streaml .xml and stream2.xml recording the stream data. 

30 (Data structure in detail) 

[011 1 ] Fig. 1 6 shows the content of the package data file package. xml in detail. 

[0112] Package data is enclosed within the <PACKAGE> tag according to XML convention as described above, and 
includes the following information. 
35 <GENERAL> general information tag 

Version information (version) 
<ACCESS> access control information tag 
Region information (region) 

[0113] The region where e-package video content can be reproduced can be restricted by using this region informa- 
40 tion to control access to video content. Time-shift distribution of a movie title can be controlled so that, for example, a 
title can be supplied first to the North American market and then in sequence to Europe and Japan , the rest of Asia 
and then China, by sequentially increasing the regions where playback is enabled or by setting the region code tor 
each particular region. The region information (region) is set to values such as "US : " "Japan," "EU," "Asia," and "China." 
<UPDATE> update announcement information tag 
45 date information (date) 

auto-update flag (auto) 

[0114] The update announcement information describes the automatic update schedule for scenarios and movie 
titles. The player (video reproduction apparatus) can automatically update to new content over the Internet based on 
this information. 
50 <INTERNET> Internet web site address tag 

URL (URL) 

[0115] This Internet web site address entry contains the URL to a web site on the Internet containing related infor- 
mation. When the user requests Internet access, this URL is accessed. 
[0116] This address is also used lo gel information for the UPDATE function. 
55 <MENU> menu information tag 

menu data file (menu) 

[0117] MENU specifies the menu data file. The menu data is written to the specified file. 
<TITLE_LIST> title list tag 
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[0118] The titles contained in the package are declared using the <TITLE> tag bracketed between <TITLEJ_IST> 
tags. 

<TITLE> title information tag 
title number (number) 
5 . title information file (file) 

[0119] The title information describes the links to each other title. Each individual title is written to the specified title 
information file. 

[0120J 1 7 shows the content of the menu information file menu.xml in detail. 

[0121] The menu information shown below is written between <MENU> tags. 
10 <MENU_PAGE> menu page information tag 

page number (page) 
background image data (image) 
[0122] The menu page information relates to multipage menus having multiple menu screens. A multipage menu is 
used, for example, when there are more 1 00 titles to display and all titles cannot be presented on one page. 
is <TITLE> title information tag 

horizontal coordinate (column) 
vertical coordinate (row) 
title number (title) 
object name (object) 
20 title name (inside the end <TITLE> tag) 

. [0123] Data for each title is written in each <TITLE> element. The player application displays the menus based on 
this information. Components specified as objects are displayed on screen as a graphical user interface. These com- 
ponents are supplied as functions of a class library of the middleware. 

[0124] lf : for example, the object attribute is set to a button as shown in Fig.. 17, a button object as defined by the 
25 graphic library of the middleware is displayed in the menu. The display position is indicated by the horizontal coordinate 
(column) and vertical coordinate (row) attributes, and the title from the title attribute is displayed on top of the button. 
[0125] Fig. 1 8 shows the content of the title data file titlel .xml in detail. 
[0126] The title data shown below is written between the <T!TLE> tags. 
<TITLE> title data tag 
30 title number (title) 

level (level) 

[0127] The level is the reproduction level of the title. Setting a package reproduction level in the e-package as de- 
scribed above makes it possible to control the reproduction level of the package according to the purchasing conditions 
of the user. More specifically, the level attribute is set to the value for a full package (full) : restricted package (restricted); 
35 or a free package (free). On the other hand, if the status attribute (Status) of the player is set to enable full package 
playback (full package) all packages can be reproduced; if the status attribute (Status) is set to restricted playback, 
packages with the level attribute set to restricted or free can be reproduced. If the player-side attribute is set to free 
only, then only free packages (free) can be reproduced. 

[0128] It should be noted that there are only three types of packages in this example, but the number of levels is not 
40 a basic problem and there could be two. four, or more levels used to restrict playback. How the divisions determined 
and what they are called shall also not be limited to those in the preceding description. 
<LINK_LIST> link list tag 

This tag defines the list of links occurring in the title. 
<LINK> data 

45 identification information (ID) 

linked package information (package) 
linked title information (title) 
linked chapter information (chapter) 
linked time information (time) 

so [0129] Link data is described at each LINK data tag. The link data is actually used in the timeline data described 
further below. Link data is defined so that the player can automatically detect whether links are valid or invalid when 
the title starts. 

<CHAPTER_LIST> chapter list tag 
<CHAPTER> chapler data 
55 start time (in) 

end time (out) 

playback stream data (video) 
subtitle data (subtitle) 
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Chapters are entries in the title data. 
<TIMELINE> Timeline data tag 
[0130] Information about events, for example, the develop along the time base are described within <TIMELINE> 
tags. The described information is as follows. 
5 <BRANCH> branching information 

level data (level) 
message data (message) 

identification data (ID) 
valid interval start time (in) 
10 valid interval end time (out) 

branch destination title (jump) 
[0131] The level data attribute (level) is a flag indicating what process is enabled according to the Status of the video 
reproduction apparatus as described above. For example, if the Status of the video reproduction apparatus is set to 
free only for playing only free packages and the level attribute (level) is set to full for playing the full package, the 
15 <BRANCH> tag is ignored. The identification attribute (ID) corresponds to the ID value in the LINK data. 

[0132] When the player model receives branch request from a user, it starts reproduction at the location described 
in the corresponding LINK, data. 
<MESSAGE> data tab 
level data (level) 
20 message data (message) 

identification data (ID) 
valid interval start time (in) 
valid interval end time (out) 

[0133] The message written in the MESSAGE tab is displayed as superimposed text using the on-screen display of 
25 the player. 

<TRIGGER> event trigger tag 
level data (level) 
event data (event) 
identification data (ID) 
30 time of event (time) 

[01 34] TRIGGER passes an event to the application when the time of the event (time) is reached. Content is written 
to the event element (event), and passed as is to the application. 
<!IMTERFACE>. data 
<PLAY> playback function control tag 
35 <STOP> stop function control tag 

<SETRATE> special playback function control tag 
<SETTIME> skip mode playback function control tag 
<SETAUDIO> audio setup function control tag 
<SETSUBTITLE> subtitle setting function control tag 
40 [0135] The interface data tag <INTERFACE> contains a number of the player function control tags described above. 
Each tag corresponds to the member functions play, stop, setRate, setTime, setAudio, setSubtitle of a Title instance. 
Each tag alsc has an attribute level (level), which is set to the same full, restricted, or free values as the package level 
attribute. 

[0136] For example : if the level attribute is full, using the member functions of the corresponding Title instance is 
45 restricted. Using said functions is enabled in this case only if the Status of the video reproduction apparatus Status is 

set to full package to enable playing the full package. The relationship between the level of each function and the 

Status of the player application is the same as with the package level (level) described above. 

[0137] Fig. 19 describes the content of the stream data file stream. xml in detail. 

[0138] The title data shown below is enclosed in <STREAM> tags. 
so <STREAM> stream data tag 

file data (file) 

[0139] The file attribute defines the file name of the stream to be reproduced. 

<ATTRIBUTE> attribute data tag 
[0140] The video and audio attribute data described below is written between <ATTRIBUTE> tags. 
55 <VIDEO> video attribute data 

compression information (coding) 
resolution information (resolution) 
aspect ratio information (aspect) 
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<AUDIO> audio attribute information tag 
compression information (coding) 
bit rate information (bitrate) 
number of channels (channel) 
5 . language information (language) 

<TIMEMAP> timemap information tag 
[0141] The time and size of each VOBU {described in detail below) is described in the timemap information. The 
timemap records the unit playback time (frame count) and data size (byte count) of each VOBU entry. 
[01 42] When skipping to a desired time in the playback stream for reproduction, the VOBU to be played is detected 
10 by adding the time information for each entry in the timemap and adding the size of each VOBU to determine the seek 
address in the file. 

[0143] The timemap data thus also functions as a filter for converting time and address information in the stream. 
<ENTRY> entry data tag 

time information (duration) 
is size information (size) 

[0144] Fig. 20 shows the content of the subtitle data file subtitle. xml in detail. 
[0145] Subtitles for each language are written between the <SUBTITLE> tags as described below. 
<LANGUAGE> language data tag 
language definition (language) 
20 character data (character) 

font information (font) 
color (color) 
italic (italic) 
bold (bold) 
25 underline (underline) 

[0146] LANGUAGE tag attributes include the language such as English or Japanese, shrft-JIS or other character 
encoding, Mincho or other font family, and style attributes. 
<TEXT> text data tag 

display start time data (in) 
30 display end time data (out) 

text 

(Stream structure) 

35 [0147] The stream is described in. detail next with reference to Fig. 21 . 

[0148] The stream used in this embodiment of the invention is based on the international standard ISO/IEC 13818 
known as MFEG-2. MPEG-2 consists of a video stream, audio stream, and system stream that multiplexes the video 
and audio streams (binding them to a single stream). 

[0149] Video data is compressed to a GOP structure including l-pictures (intraframe coded) : P-pictures (temporally 
40 predictive coded), and B-pictures (bidirectionally temporally coded). The referential relationship between these pictures 
is shown in Fig. 21 . 

[0150] The compressed video data is packetized and then packed, and then multiplexed with the audio data to form 
a single system stream. 

[0151] VOBU are then formed based on the GOP (from a pack containing the beginning of a GOP to the pack at the 
45 beginning of the next GOP) in the multiplexed layer. The VOBU is introduced because a GOP is defined ai the video 
layer and is not applicable to definition at the system layer. 

[0152] The MPEG-2 system stream is also referred to as a VOB (Video Object) in this embodiment of the invention. 
(Player structure) 

50 

[0153] Fig. 22 is a block diagram of a video reproduction apparatus. 

[0154] The video reproduction apparatus has a receiver 1 01 for receiving data from a set-top box or other external 
tuner a storage medium 1 02 for recording data : a CPU 1 03, program memory 1 04, working memory 1 05, decoder 1 06 
for decoding a sLream, display 107 for presenting output to a monitor and speaker, and an interface 108 for receiving 
55 user requests. The CPU 103 has an internal clock for time and data information, and the playback control status (full, 
restricted, or free) of the video reproduction apparatus is stored to the working memory 105. 



12 



EP 1 381 232 At 



(Class library details) 

[01 55] Fig. 23 shows the software structure of the e-package video reproduction apparatus. 

[0156] The software structure is built around an operating system (OS 203) with a file system driver 201 and device 
5 drivers 202 under the OS 203. The file system driver 201 provides an environment for accessing data on the disk as 
files or applications using a directory structure. The device drivers 202 control computer hardware devices such as 
decoders and graphics cards. 

[01 57] Middleware 204 is installed on top of the OS. In the case of Java, for example, the Java Virtual Machine (JVM 
below) and class libraries are installed. An e-package class library 205 is also installed as one of these class libraries. 
10 [0158] The standard class libraries and the e-package class library provide a programming environment of classes 
and member functions to applications. 

[0159] in addition to a specialized e-package player application 206, external applications 207 provided by third 
parties can operate as applications. 

[0160] Fig. 24 shows the structure of the e-package classes included in the middleware. 
15 [0161] E-package classes in the middleware include a Package class, Title class, Menu class, Audio class, Subtitle 
class, Event class, Link class, Cursor class, and Status class. Each of these is described below. 

* Package class 

20 [0162] The Package class is the first class called. A Package class instance is created based on the package data 
file package. xml. 

[0163] Fig. 25 shows the process controlled by the Package class. 

[01 64] The Package constructor (package) reads package.xml and gets the attribute values for a Package instance 
(2501 ). The attribute values of the instance are all described in the management data file as noted above. 
25 [0165] Whether package playback is enabled is then verified based on the region information, level information, and 
expire date information (2502). If playback is prohibited, an error is returned to the application and the process ends 
(2503). 

[0166] If the verification process is passed (playback is permitted), an update check is run (2504). 
[0167] The date and time values of the <UPDATE> tag are then compared with the date and time values from the 
30 CPU: if the update notification date has passed and the automatic update attribute is set to "yes," the update is down- 
loaded from the Internet (2505) and playback is resumed using the new playback control data (2501). 
[0168] If an update is not downloaded as a result of the update check (2504), a Menu instance is created (2506) and 
a Title instance is created (2507). 

[0169] A Package instance has getMenu and getTitles member functions. After a Package instance is created the 
35 application calls these functions to create Menu and Title instances. 

* Title class 

[01 70] The Title class controls playback of a title. An instance is created for each title and drawn on screen by adding 
40 the title instance to a Canvas instance. Playing a title is controlled by calling the member functions. 
[0171] Fig. 26 and Fig. 33 show the Title class process. 

[0172] The Title constructor (title) reads title. xml when initiated (2601) and internally generates a Link list based on 
Link_LIST (2602). Whether the titles are stored in an accessible location is checked at this time and any inaccessible 
titles are deleted from the list. More specifically, this check determines whether the files exist using a network protocol 
45 for example, but this is not directly related to the present invention and detailed description thereof is therefore omitted. 
[0173] A Chapter list is then generated (2603), the attribute data file (stream. xml, for example) for the stream refer- 
enced by the Chapter is read (2604), and Audio and Subtitle instances are created (2605). 

[0174] Based on theTIMELINE information a Timeline list is then generated (2606) : a function list is generated based 
on the INTERFACE data (2607). and finally a. Cursor instance is created (2608) for handling requests input from a 
50 remote control device (interface). 

[0175] The Title class also has various member functions. 

[0176] Functions for directly controlling AV playback are play, stop, setRate setting the playback rate, and setTime 
setting the playback location. These functions serve the functions provided by the decoder directly to the application. 
For example, when play() is called by the application, the play() function checks whether playback is permilled or not. 
55 and the decoder is instructed to start playback only if playback is permitted. 

[0177] Consider a case in which the playback function (play) is called from the application. The playback function 
(play) compares the playback status of the player (full playback, restricted playback, free only) with the usage restriction 
of the play() function from the function list (2611). If using this function is permitted, the function is run (2612). If using 
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the function is not permitted, however, processing the function ends. 

[0178] The relationship between the permitted and not -permitted status of the function is shown in the following table. 



level = 


full 


restricted 


free 


Status full playback 
restricted playback 
free only 


permitted 
not permitted 
not permitted 


permitted 
permitted 
not permitted 


permitted 
permitted 
permitted 



10 [01 79] This table applies not only to whether using functions of a Title instance are permitted or not permitted, but 
also for determining whether playback is permitted for the package level. 

[0180] Audio and subtitle control are handled by getAudio and getSubtitle for getting the appropriate streams in the 
title; that is, an instance with the attribute values of each language, and setAudio and setSubtitle for setting the streams 
to play back. 

15 [0181] getAudio and getSubtitle pass the Audio instance and Subtitle instance created by the Title constructor as 
the respective return values to the application (2621). The application sets the playback stream using these instances 
as arguments of setAudio and setSubtitle. 

[0182] The setAudio and setSubtitle functions first determine if using the functions is permitted (2631). More specif- 
ically, the playback status of the video reproduction apparatus (full playback, restricted playback, free only) is compared 
20 with the usage restriction of the corresponding function contained in the function list. If the function can be used, the 
attribute values of the playback stream are set in the decoder according to the attribute values of the received instance 
(2632). If using the function is not permitted, however, processing the function ends. 

[0183] The status of the video reproduction apparatus and these functions are compared using the table shown 
above. 

25 [0184] In addition to the above, the Title class also has an enableEvent function for starting event processing and 
an enableLink function for starting processing title links. 

[0185] The enableEventf unction processes thetimeline information (<TIMELINE>) described in the Title information, 
that is, the <BRANCH> information, <Message> information, and event trigger information (<TRIGGER>). The ena- 
bleEvent function starts an internal thread when it is called (3301). The initiated thread runs the looping process de- 
30 scribed below. 

[0186] That is, enableEvent monitors the playback time information to detect whether the current time matches the 
enable event time indicated for events on the timeline list, that is, whether the time matches the time indicated in the 
' <BRANCH> data, <Message> information, or event trigger information (<TRIGGER>). for example (3302). If the time 
matches the enable event time, the Status of the video reproduction apparatus is checked (3303) to determine whether 
35 the event is permitted on the video reproduction apparatus. 

[0187] If the event is permitted, it is determined whether the event type is a BRANCH requiring a request from the 
user (3304). 

[0188] If the event is a BRANCH, enableEvent waits for a user request (3305) and loops to wait for a request until 
the BRANCH times out (indicated by out) (3306). If BRANCH times out (determined by out) without receiving a request, 

40 enableEvent loops back to the beginning (3302). If a request is received from a user before BRANCH times out, an 
instance of the branch Title (declared by jump) is created and the corresponding title is played back (3307). 
[0189] If a BRANCH process is not detected in step 3304, that is, if a MESSAGE or event TRIGGER is detected, 
enableEvent goes to step 3308 to determine if the process is a MESSAGE or event trigger (TRIGGER). If the process 
is a message (MESSAGE), a Text instance is created from the specified message information (message) (3309), and 

45 the Text instance is added to a Canvas instance (3310). The message display is held until the message presentation 
period times out (out) (3311). and at the end of the message presentation period (out) the Text instance is deleted 
(deleted from the Canvas instance) (3312) and enableEvent returns to the beginning of the loop (3302). 
[0190] If a TRIGGER process is detected in step 3308 an Event instance is created (3313), the eventExec function 
implemented by the application is run (331 4), and the process then returns to the top of the loop (3302). 

50 

* Menu class 

[0191] The Menu class presents menus derived from the Title class. An instance is created for each menu of the 
same title and added to a Canvas class for presentation on screen. 
55 [0192] Fig. 27 shows the Menu class process. 

[01 93] The Menu() constructor reads the menu information file menu.xml (2701), passes a Title class process (2702) 
and generates menu pages (2703).. presents the top menu page (2704), and starts a menuThread for handling Cursor 
events (2705). 
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[0194] The content displayed by each page is described using the <MENU_PAGE> tag in the MENU data as de- 
scribed with reference to Fig. 1 7. A button is created based on the <TITLE> element within the MENU_PAGE element 
and displayed on screen. 

[01 95] The nextPage member function enables navigating to the next page (2711 ) and the prevPage memberf unction 
5 enables navigating to the previous page (2721) in the case of multipage menus. If a title is selected, the selectecffitle 
member function reports the selected title to the application (2731 ). 

[0196] ThemenuThread member function starts a thread (2741 ) and receives events from the Cursor instance (2742). 
When an event is received from a Cursor instance, menuThread detects if the event is a title selection (2743); if a title 
selection event is detected the selectTltle function is called (2744) and the selected title is reported to the application. 
10 [0197] If a title selection is not detected in step 2743 menuThread detects if the event is a page navigation event 
(2745); if yes : it is determined whether page navigation is to the next page or the previous page (2746) and the corre- 
sponding nextPage (2747) or prevPage (2748) function is called. 

* Audio class and Subtitle class 

15 

[0198] The Audio class contains attribute values for each audio stream. If, for examp!e : there are two usable audio 
streams in a title, two instances of the Audio class are created. The audio stream to be reproduced is set by setting 
one of the Audio class instances to the setAudio function of the Trtle class. 
[0199] Fig. 28 shows the Audio class process. 
20 [0200] The AudioQ constructor reads the stream attribute data file stream.xml (2801 ) and stores the attribute values 
to the Audio class instance. 

[0201] The Audio class also returns the language of the instance, that is, the language of the audio stream, to the 
application using the getLang member function (2811), returns the compression method of the instance, that is, the 
compression method of the audio stream, using the getCoding member function (2821), and returns the channel in- 
25 formation of the instance, that is, the number of channels in the stream, using the getChs member function. 
[0202] The Subtitle class has the same functions as the Title class. 

* Event class and Link class 

30 [0203] The Event class is the class for generating events in a title, and the Link class is the class for generating title 
linking data events in a title. 

[0204] Fig. 29 shows the Event class and Link class processes. 

[0205) The Event class constructor sets the Event attributes based on the parameters (2901 ). 

[0206] The Event class member function execEvent is a function overridden by the application. That is, starting 
35 execEvent starts an event handler (291 1 ). execEvent has an ID (id) as an argument enabling the application to identify 
what event trigger (TRIGGER) was applied and then branch to the triggered process. 
[0207] The Link class constructor creates an instance of the Title supplied as an argument. 

[0208] Like execEvent, the Link class member lunction notifyLink is a function overridden by the application , and the 
Link class passes a Title instance to the application using this function and runs the event process. 

40 

* Cursor class 

[0209] The Cursor class processes cursor events on screen, and is described with reference to Fig. 34. 

[0210] The Cursor class constructor first generates/initializes the location information (3401 ) ; starts communicating 

45 with the remote control device (3402), and starts the cursor event handling thread CursorThread (3403). 

[0211] The cursor event handling thread CursorThread first starts a thread (3411 ) and initiates the process loop. The 
process loop checks for cursor movement (3412), calls the moved function if the cursor moved (3413), and updates 
the location information. If a selection action is detected when the cursor did not move or after step 3413, that is, if 
user execution of a selection operation on a button selected by the cursor is detected (3414), the selected function is 

so called (341 5) and the selection passed to the current Title. 

[0212] Based on a declared argument the moved function refreshes the location information (3421 ), and the selected 
function passes the selection execution request to the Title instance (3431). 

* Slalus class 

55 

[0213] The Status class describes the status of the video reproduction apparatus. This class is unique to the video 
reproduction apparatus or system and is not instantiated each time. The Status class can be accessed directly from 
the application. 
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[0214] A getStatus function enabling the application to know the status, and getPeriod function for knowing the valid 
period : are provided for class access 

[0215] As shown in Fig. 35, the Status class internally generates Status information and Period information based 
on values provided as parameters (3501). The getStatus member function returns the Status data to the application 
5 . (3511), and the getPeriod member function returns the Period data to the application (3521). 

* Frame class and Canvas class 

[0216] These classes generate windows. The Frame class is the base class used for displaying a screen, and is 
10 equivalent to a window seen on the Windows OS. A Canvas instance for presenting moving pictures is added to a 
Frame instance. 

[0217] The Canvas class is described with reference to Fig. 36. 

[0218] The Canvas class constructor creates a Frame instance for overlaying video data to the display (3601). The 
decoder is then initialized (3602) and an overlay, that is, graphics function, is initialized (3603). The decoder initialization 

15 process and graphics function initialization process are dependent upon the underlying operating system (OS) and 
hardware, are not fundamentally related to the present invention, and detailed description thereof is therefore omitted. 
[0219] A window is drawn on screen by a Canvas instance : but drawing the actual images is done by the member 
function add. The add function is called as an argument of the Title instance, reads the stream data of the Title instance 
(3611) and sets the decoder (3612). The add function also causes the decoder to start the decoding process (3613), 

20 and starts drawing the decoded images to the overlay (3614). 

[0220] The Canvas class also has a setSize member function whereby the Canvas size can be changed. The internal 
processes include changing the size of the Frame instance (3621 ) and changing the display size of the overlay (3622). 

(Player reproduction process) 

25 

[0221] The reproduction process executed as the player application is described next. 
[0222] Fig. 30 is a flow chart of the reproduction process of the player. 

[0223] After activation (3001), the player application creates a Canvas instance as described below and generates 
a video presentation window (3002), The internal operation of the Canvas instance is as described with reference to 

30 Fig. 36. 

Canvas objCanvas = new Canvas(); 
[0224] The above expression is based on the Java language. "Canvas" at the left end is the class declaration, the 
following "objCanvas" declares that it is an object (instance) of the Canvas class, and "new Canvas()" calls the Canvas 
class constructor whereby the objCanvas instance is created. 

35 [0225] The player application then waits for a package selection by the user (3003). After a package is selected, a 
Package instance is created as described below (3004), and a menu instance is obtained (3005) and the menu pre- 
sented (3006). A Package instance is created as described with reference to Fig. 25. 
Package objPackage = new Package(package); 
Menu objMenu = objPackage. getMenu(); 

40 objCanvas. add(objMenu); 

[0226] As shown in Fig. 31, a menu includes a background image and a title information display (text). A title is 
selected (3007) by moving the cursor with the remote control to the desired title and performing a "selection" action. 
[0227] The cursor is moved using keys (up, down, right, left) on the remote control, and cursor movement and se- 
lection operations are detected and processed by the CursorThread function initiated as a thread as described with 

45 reference to Fig. 34. 

[0228] If moving to the next page is selected, for example, the selected function of the Cursor instance is called and 
the Menu instance knows that a page navigation request was issued. The Menu instance then calls the nextPage 
function to send the menu to the next page. 

[0229] if a selection action is executed with the cursor on title 4, for example, the Menu instance knows that a title 
so was selected through the selected function of the Cursor instance. The selectedTitle function then notifies the appli- 
cation that a title was selected, and the application advances to the title reproduction steps (3008 and following). 
[0230] Using the selected title information as an argument, the player application calls the getTitle function of the 
Package instance and gets a Title instance (3008). The player application then calls the play function of the Title 
instance to start playback (3009), and calls the enableEvenl function to start an event thread (3010). 
55 Title obiTitle = objPackage. getTitle (title); 

objTitte.play(); 
objTitle.enableEvent(); 

[0231] Event detection (301 1) : event processing when an event is generated (3012), and detecting the end of title 
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playback (301 3) then repeat until reproduction of the title is completed. Processing by the player application ends when 
it is confirmed that title playback has ended (3014). 

[0232] Event processing in step 301 2 is as described above with reference to Fig. 33. 
[0233] Jumping between titles while reproducing a title is described with reference to Fig. 32. 
5 [0234] A period in which jumping to Title 2 is enabled is set in Title 1 as shown in the figure. This jump period is 
defined using BRANCH tags and associated attribute values inserted to the TIMELINE data in the Title 1 data file 
titlel .xml. A message is displayed as shown at the bottom in Fig. 32 during this jump period, and playback moves to 
the point in Title 2 indicated by the link if the user presses a "select" key. 

[0235] When the jump period (the period specified by the in and out attributes of the <BRANCH> element) is entered 
10 (Fig. 33, 3302), the Status of the BRANCH process and the Status of the video reproduction apparatus (fetched using 
Status. getStatus()) are compared (as shown in the above table); if processing is permitted (Fig. 33, 3303), the BRANCH 
is confirmed (Fig. 33, 3304) and a loop waiting for a user request is entered (Fig. 33, 3305 and 3306). 
[0236] Selection requests from the user are received through a Cursor instance (Fig. 34, 3414 and 3415). When a 
selection request from the user is detected a new Title instance is created and reproduction of the next title (Title 2 in 
15 Fig. 32) begins (Fig. 34, 3307). If a user selection request is not detected by the end of the jump period (out) : the 
BRANCH process ends after a timeout is detected (Fig. 33, 3306). 

[0237] Fig. 37 is an example of a game application. In this example a game application runs instead of a player 
application (3701). As with the player application, a Canvas instance is created and a video display window generated 
(3702). The internal operation of creating a Canvas instance is as described with reference to Fig. 36. 
20 Canvas objCanvas = new Canvas(); 

[0238] The game application starts the game (3703), gets a Package instance used by the game application (3704), 
and gets a Title instance (3705). The play function of the Title instance is then called to start playing the title (3706), 
and the enableEvent function is called to activate an event thread (3707). 

Package objPackage = new Package(package); 
2s Title objTitle = objPackage. getTitle(title); 

objTitle.play(); 

objTitle.enableEventO; 

[0239] Event detection (3708), event processing when an event is generated (3709), and detecting the end of title 

playback (3710) then repeat until the game ends. Game application processing ends when it is confirmed that the 
30 game has ended (3711). 

[0240] The game and AV playback in a game application can be synchronized using an event trigger. An event trigger 

element (<TRIGGER>) as shown below could, for example, be inserted to the timeline data element (<TIMELINE>) in 

the title information (<TITLE>) described with reference to Fig. 18. 
<TRIGGER level= ,, full n id="1" event= u 1" time="00:01 :00:00"/> 
35 [0241] At time 00:01 :00:00 (1 minute), the event thread confirms the indicated time (time) (Fig. 33, 3302), confirms 

the Status (Fig. 33, 3303), confirms the branch selection (Branch) (Fig. 33, 3304), checks the message (Message) 

(Fig. 33 : 3308), generates the Event (Fig. 33, 331 3) : and then runs execEvent (Fig. 33, 3314). 

[0242] The game application overrides the activated member function execEvent, and based on the id obtained from 

execEvent is able to synchronize processing on the game side. 
40 [0243] Fig. 38 and Fig. 39 describe an example for updating the Status and Expire values from a server over a 

network in order to remove the playback restrictions imposed by the Status and expiration date (Expire) settings of the 

package and the video reproduction apparatus. 

[0244] As described with reference to Fig. 25, whether or not a package can be reproduced is verified (Fig. 25, 2502) 
by comparing the playback level (level) and expiration date (expire) settings of the package with the Status setting and 
45 date/time information of the video reproduction apparatus. If playback is permitted, processing proceeds from step 
2504, and if playback is net permitted the reproduction process ends with step 2503. 

[0245] A process for updating the Status of the video reproduction apparatus or the expiration date (expire) of the 
package can be run instead of terminating the reproduction process (2503 in Fig. 25). 

[0246] Fig. 39 shows an example of communicating with a server to update the Status of the video reproduction 
50 apparatus when playback is not possible because the Status of the video reproduction apparatus does not match the 
package level setting (level). 

[0247] Instead of terminating (2503 in Fig. 25), the Status is updated (2503) in the example in Fig. 39. This is ac- 
complished by first activating an update application (250301). This update application can be a single application 
executing al the middleware level in Lhe same way as Lhe player application and game application, or il could be a 
55 binary code base application run directly at the operating system level. If it is an application run at the middleware 
level, the player application could activate the update application through the Loader class. 

[0248] The update application communicates with the server (250302) using a Socket class provided by middleware 
(Java) or directly using a network protocol (such as TCP/IP). The server that the update application talks to is indicated 
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by the Package <INTERNET URL = "7> element. The application then communicates with the server to obtain the 
condition (monetary amount) required to update the Status (250303), and presents the update conditions to the user 
(250304). 

[0249] The application then waits for a response from the user (250305). If the user wants to update the Status 
5 . (250306) : a transaction is processed with the server (250307), a Status update process is run (250308), the update 
application then terminates (250309), and the player application continues processing from step 2501 in Fig. 25. 
[0250] This transaction process can be handled by inputting and communicating a credit card number. Various tech- 
nologies are available for processing payments using the Internet, are not fundamentally related to the present Inven- 
tion, and detailed description thereof is therefore omitted. 
10 [0251] If the user elects to not update the Status in step 250306, the process terminates (250310). 

[0252] It should be noted that while updating the Status is described here by way of example, updating the expiration 
date (expire) can be handled in the same way. In this case, however, the package expiration date (expire) is updated 
instead of updating the Status of the video reproduction apparatus. If the package is recorded to rewritable media, the 
expire date can be updated directly. If stored to read-only media, the expiration information can be re-used by providing 
15 a system for temporarily recording the expiration information (expire) to a hard disk drive, non-volatile memory, or other 
temporary recording medium available to the video reproduction apparatus. 

[0253] A video reproduction system according to the present invention is directed not only to a video reproduction 
apparatus for simply playing movies, but also to achieving a variety of other applications. This video reproduction 
apparatus therefore includes middleware for absorbing differences in function according to the type of operating system 

20 as software read into and run in internal memory. This middleware has class libraries containing tools enabling the 
player application to reproduce video content and used to run expanded applications including game applications. 
More specifically, this middleware contains e-package class libraries as described above. The tools are classes and 
member functions used to achieve the various functions. Functions provided to the player application, game application : 
or other application by these class libraries are described in the function list recorded to the playback control data 

25 (management information) contained in the package media. This function list also has Status information for each 
function, and by comparing this Status information with the Status information of the video reproduction system, it is 
possible to control at the function level the content that can be reproduced by a video reproduction system. 
[0254] It is therefore possible to control various e-package applications according to the type or quality of business 
or service. 

30 [0255] Although the present invention has been described in connection with the preferred embodiments thereof 
with reference to the accompanying drawings, it is to be noted that various changes and modifications will be apparent 
to those skilled in the art. Such changes and modifications are to be understood as included within the scope of the 
present invention as defined by the appended claims, unless they depart therefrom. 

35 

Claims 

1 . A video reproduction apparatus for reproducing externally supplied package media, wherein: 

40 the package media contains video content storing video data and playback control data for controlling repro- 

duction of the video data in a specified data format, and extensible application software for using the video 
content, 

the video reproduction apparatus comprises as software stored and executed in internal memory 

45 an operating system chosen from operating systems of plural types. 

middleware for absorbing differences in function according to the type cf operating system, and 
player application software that runs on the middleware level for reproducing the video content; 

the middleware having a class library including tools used by the player application to play back the package 
so media or to run the extensible application software; 

the player application software consistently reproducing the video content of the package media according to 
the specified format by way of the tools included in the middleware class libraries; and 
the extensible application software running by way of the tools included in the class libraries of the middleware 
using video conlenl conlained in the same package media. 

55 

2. A video reproduction apparatus according to claim 1 , wherein the video reproduction apparatus manages playback 
status data, the playback control data of the package media includes playback restriction data corresponding to 
the playback status data, and the extensible application software sets a tool contained in the class libraries of the 
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middleware to an invalid state by analyzing the playback control data and comparing the playback restriction data 
in the playback control data with the playback status data. 

A video reproduction method for reproducing externally supplied package media with a video reproduction appa- 
ratus, wherein: 

the package media contains 

video content storing video data and playback control data controlling reproduction of the video data in a 
specified data format, and 

extensible application software for using the video content; 

the video reproduction method comprising: 

a step for reading into internal memory of the video reproduction apparatus and activating an operating 
system chosen from operating systems of plural types; 

a step for reading into internal memory of the video reproduction apparatus and activating middleware for 
absorbing differences in function according to the type of operating system, the middleware having a class 
library including tools used by application software operating at the middleware level to run or reproduce 
the package media; 

a step for reading into internal memory of the video reproduction apparatus and activating a player appli- 
cation operating at the middleware level for reproducing the video content; 

a step for reading into internal memory of the video reproduction apparatus and activating extensible 
application software operating at the middleware level and using the video content, 

wherein the player application software consistently reproduces the video content of the package media 
according to the specified format through the tools included in the class libraries of the middleware, and 

wherein the extensible application software runs by way of the tools included in the class libraries of the 
middleware using video content. 

A video reproduction program for reproducing externally supplied package media, wherein: 

the package media contains 

video content storing video data and playback control data controlling reproduction of the video data in a 
specified data format and 

extensible application software for using the video content; 
the video reproduction program comprises as software stored and executed in internal memory: 
an operating system chosen from operating systems of plural types, 

middleware for absorbing differences in function according to the type ct operating system, and 
player application software that runs on the middleware level for reproducing the video content; 

the middleware having a class library including tools used by the player application to play back the package 
media or to run the extensible application software; 

the player application software consistently reproducing the video content of the package media according to 
the specified format by way of the tools included in the middleware class libraries; and 
the extensible application software running by way of the tools included in the class libraries of the middleware 
using video content contained in the same package media. 

A computer-readable recording medium storing a video reproduction program according to claim 4. 

Package media externally supplied lo a video reproduction apparatus and reproduced by the video reproduction 
apparatus : the package media containing: 

video content storing video data and playback control data controlling reproduction of the video data in a 
specified data format, and 
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extensible application software for using the video content; 

the video reproduction apparatus comprising as software stored and executed in internal memory: 

5 . an operating system chosen from operating systems of plural types; 

middleware for absorbing differences in function according to the type of operating system; and 
player application software that runs on the middleware level for reproducing the video content; 

the middleware having a class library including tools used by the player application to play back the package media 
10 or to run the extensible application software; the player application software consistently reproducing the video 

content of the package media according to the specified format by way of the tools included in the middleware 
class libraries; and the extensible application software running by way of the tools included in the class libraries 
of the middleware using video content contained in the same package media. 
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